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SOLVABILITY OF MATRIX RICCATI INEQUALITIES 


KEVIN KISSI 


Abstract. We consider matrix Riccati inequality arising in the theory of absolute sta¬ 
bility, Hoo control problem, LQ problem, and optimal estimation problem. In the case of 
sign definite frequency domain function, the solvability of Riccati inequalities is a subject 
of the famous Kalman- Yakubovich lemma. This paper presents necessary and sufficient 
conditions for solvability of Riccati inequality in the general sign indefinite case. To this 
end we use special representations of Hamiltonian matrices. The results are illustrated by 
an example. 


1. Introduction and Problem statement 
Consider the Riccati inequality 

HA + A*H + G — HBT~ l B*H < 0, (1) 

where A, B , G, T are given matrices of dimensions nx?i,nxm,nxn, and mxm respectively; 
G, r are Hermitian matrices, det T ^ 0. We are looking for necessary and sufficient condi¬ 
tions for existence of stabilizing and anti stabilizing solutions of the inequality (H|), that is, 
for matrices and H + such that (JXj) holds for both of them, and matrices A — 

—(A — BT~ 1 B*H + ) are Hurwitz. 

In case when matrix T is sign definite, the answer to this problem is given in the fa¬ 
mous Kalman-Yakubovich lemma [T]. This lemma, has been originally proved in [3], then 
extended to infinite dimensional case in [5] and formulated in the most general form in [7], 

For positive definite matrices T solvability of inequality (jT]) may be reduced to solvability 
of the algebraic Riccati equation (ARE) 

HA + A*H + G- HBT~ l B*H = 0, 

which is closely related to the existence and properties of maximal J-orthogonal invariant 
subspaces of Hamiltonian matrices (see m, m)- Such equations are very important in the 
theories of optimal control, absolute stability, game theory, H <*, control (in the last two 
cases the matrix T is sign indefinite) 

A number of important results concerning solvability of Riccati inequalities were pub¬ 
lished in [8j. In this paper a new idea related to positive definiteness of matrix AI (see the 
text below) is used. 

Theory of absolute stability study systems of the form 

= Ax + a = C*x , , , 

f = ¥><*,<) (2) 
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in the class Alp of nonlinearities ip satisfying the following Local Quadratic Constraint 
(LQC): 


F(x,ip(C*x,t)) > 0 Vx,t, (3) 

where F is given quadratic form. The first and most known LQC is so-called sector condi¬ 
tion: 


(f - aC*x)*T{pC*x - 0 > 0, 

where a, /3, T > 0 are diagonal matrices, but there are a lot of other useful constraints [!]• 

System (j2J) is called absolutely stable in the class Alp, if system (© with every function 
<p E Alp is globally asymptotically stable, and this stability is uniform with respect to 
functions <p £ Np. 

If there exists a positive definite quadratic form V(x) = x*Hx such that V(x(t)) is 
decreasing along all non zero solutions of systems © with all functions ip £ Alp, then 
system © is absolutely stable in Alp. 

Such Hermitian matrix H exists if and only if the quadratic form 

x*H(Ax + Bi) < 0 

for all non zero vectors (x*,£*)*, for which F(x,£) > 0. 

According to Dines theorem such matrix H exists if and only if there exists a Hermitian 
matrix H such that 


2x*H(Ax + B£) + F(x,£) <0 (4) 

for all non zero vectors (x*,£*)*. 

Assume F(x,£) = x*Gx — with T > 0. Then inequality © holds if and only if the 
following Riccati inequality holds 

HA + A*H + G + HBT~ 1 B*H < 0. (5) 

Notice that the quadratic term of the left hand side is sign semidefinite. 

Another example of problems where the Riccati inequalities arise is the problem of 
control. 

Consider system 


— = Ax + B w w + B u u , (6) 

where matrices A , B w , B u are constant, x is state vector, w is exogenous input (noise for 
example), and u is control. 

Consider a quadratic function 


F(x, w, u ) = x*Gx + u*T u u — w*T w w , 
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where constant Hermitian matrices G, T u > 0 and r w > 0 are given. The problem consists 
of finding a controller u = hx such that the closed loop matrix A + B u h is Hurwitz, and for 
all non zero functions w € Z> 2 (0, oo) along solutions x with trivial initial value x(0) = 0 we 
have 


F(x(t),w(t),u(t))dt < 0. 

This problem may be reduced to solvability of the following Riccati inequality 

HA + A*H + G + HB w T- l B* w H - HB u Y~ x BlH < 0. 

Notice that matrix of quadratic form in this inequality in many cases is sign indefinite. 

Now consider a relation between the Riccati inequalities and the Kalman-Yakubovich 
lemma. 

Without loss of generality we assume that pair (A,B) is controllable and matrix A has 
no pure imaginary eigenvalues. 

If matrix T is negative definite, then inequality dH) may be represented as linear matrix 
inequality (LMI): 



f HA + A*H + G HB \ 

^ B*H T ) < U ‘ 

It may be solved via well-known technique. 

Solvability of inequality (JT]) is also a subject of the famous Kalman-Yakubovich lemma 
[Ij. According to this lemma, inequality dD has a solution, if and only if, the following 
frequency domain inequality holds: 


for all ui £ [—oo, oo], where 


7r(zcu) < 0, 


vr(A) = T + B*(XI + A*)~ 1 G(A - A I)~ l B, 

or, which is the same, 


(7) 


det 7r(zcu) / 0 (8) 

for all ui £ [— 00 , 00 ]. 

But if matrix T is not sign definite, the inequality (J8]) proved to be no longer necessary 
for solvability of inequality ([T]). In this paper we present the desired necessary and sufficient 
conditions, which may be considered as generalization of Kalman-Yakubovich lemma to the 
case of sign-indefinite quadratic forms. 

2. Hamiltonian matrices 

In this section we present a new necessary condition for solvability of inequality dl]) , which 
will be proved later on to be also sufficient. 

In the sequel we shall use the following matrices: 
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R = 


A -BT~ l B* \ 
-G —A* ) ’ 



- 1 
0 


Matrix JR is clearly Hermitian, therefore, matrix R is (J-)Hamiltonian [2]. 

The set of eigenvalues of Hamiltonian matrix is symmetric with respect to the imaginary 
axis. Indeed, if det(R — XI) = 0, then 


0 = det(R - XI) det(J) = det (JR - XJ) = det (R*J* - XJ) = 
= det (R*(-J) - A J) = det(-R* - Xl)det(J), 

Therefore 


0 = det(i?* + XI) = det (R - (-A/)), 
and —A is an eigenvalue of R. 

It has been shown [6] that the structure of Jordan blocks corresponding to eigenvalues A 
and —A of matrix R coincide. 

Assume matrix R has no eigenvalues on the imaginary axis. Then there exist n x n- 
matrices A, Xi, T i, X- 2 , T 2 such that all eigenvalues of matrix A have negative real parts, 
and 


( A, X 2 \ f A, A 2 A ( A 

\ j V ^1 J V 0 

Hence, we have the following equalities: 

AX, - BT^B*^! = A, A 
—GXi - A*d> 1 = TiA. 

Assume matrix X\ is nonsingular. Multiply the first equation by TiA-j ” 1 from the left, 
by A ^ 1 from the right. Multiply the second equation by A ^ 1 from the right. Add the 
equations. Then with notation H = TiA ^ 1 we have 

HA + A*H + G — HBT~ l B*H = 0. (10) 

Hence, H is a solution of the Riccati equation (fTUj) . 

Why H is Hermitian? Denote Z = col{X\, Ti). Then RZ = ZA and 

Z*JZA = Z* JRZ = Z*(JR)*Z = ( RZ)*J*Z = (-A *)Z*JZ. 

But matrices A and —A* have no common eigenvalues. Therefore 

Z*JZ = 0. 

Recalling the definition of Z we get 



-a(t 2 + ;ai = 0 , 

which it turn is equivalent to (TiAj -1 )* = TiA^ 1 , or H* = H. 
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Notice that A — BY 1 B*H = X 1 KX 1 1 . Therefore matrix A — BY 1 B*H is Hurwitz, 
and H is a stabilizing solution of the Riccati equation (110[) . 

If we consider matrix col(X 2 , T 2 ) instead of Z, we arrive to a solution H such that matrix 
— (A — BY~ l B*H) is Hurwitz. Then H is anti stabilizing solution of the Riccati equation 

00 - 

Inverse, if H is a solution of the Riccati inequality <[9|), then for some positive definite 
matrix AG, matrix H is a solution of the Riccati equation 

HA + A*H + G + AG - HBY~ l B*H = 0. (11) 

Assume H is a stabilizing solution of equation (llip . Then for some representation ([9]) of 
matrix 


_ / A -BY^B* \ 
hnr,r ~\-G-AG -A* ) 

we have A — BY~ 1 B*H = X\AX^~ , and therefore matrix A is Hurwitz. In particular, it 
means that matrix R new has no pure imaginary eigenvalues. 

Thus, the problem of finding necessary and sufficient conditions for existence of stabilizing 
and anti stabilizing solutions of Riccati inequality ([Tj) is reduced to a problem of existence 
of a positive definite matrix AG such that matrix R new has no pure imaginary eigenvalues, 
and in the representation © matrices X\ and X 2 are nonsingular. 

3. Special Transformation 

Assume V\, V 2 are n x m-matrices, and V = col(V\, V 2 ). Denote by R(V) the Hamiltonian 
matrix 


R + V{JV)* 


A-ViV 2 * —BY~ 1 B* + V\V* \ 

-G - V2V2 —A* + V 2 V* J ' 


The corresponding Riccati equation has a form 


H(A - ViV 2 *) + {A - ViVJ)*H + G + V 2 V 2 * - HBY~ 1 B*H + HV\ V*H = 0. (12) 

For a solution H of this equation we have 


HA + A*H + G- HBY~ l B*H = ~(V 2 - HV[)(V 2 - HV\)* < 0. 

If the right hand side is strictly negative, then H is a solution of inequality (JTI) . 


4. Special case 

Assume matrix R has no pure imaginary eigenvalues. Then for sufficiently small positive 
number e matrix R(el ) also has no pure imaginary eigenvalues. 

Consider a representation Q of matrix R(el). For every positive number 5 there exists 
a Hamiltonian matrix 
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A -BT ~ 1 B* + eI 

~ V -G- el -A* 

such that || R(el) — R|| < <5, and in the representation Q of matrix R matrices X\, X 2 are 
nonsingular. Denote by H the stabilizing solution of corresponding Riccati equation. Then 

HA + A*H + G- HBT^B'H = 

= H(A - A) + (A - A)*H + {G-G + el)~ 

-{HBT~ l B*H - HBT~ 1 B*H) + HeH. 

For sufficiently small number 5 the right hand side of the equality is negative. Therefore, 
H is a solution to the Riccati inequality (|T]). Since matrix A — BT~ 1 B*H is Hurwitz, for 
sufficiently small number 5 the matrix A — BT~ 1 B*H is Hurwitz, and H is a stabilizing 
solution of inequality (fTj). 

The same conclusion is true for the anti stabilizing solution of inequality (JT]) . 

Thus, if matrix R has no pure imaginary eigenvalues, then the Riccati inequality (JT]) has 
both stabilizing and anti stabilizing solutions. 

5. General case 

Now consider general case: matrix R may have pure imaginary eigenvalues. Our next 
goal is to figure out how eigenvalues of matrix R + V(JV)* depend on V. 

We need the following definitions. 

Definition 5.1. Let P be a subspace of C 2n , and T be a matrix such that set of columns 
of P is a basis of P. Denote by n_(P), no(P), and n + (P ) the numbers of positive, zero, 
and negative eigenvalues of matrix T*iJT respectively. 

Obviously, these numbers do not depend on the choice of basis T of P. 

Denote by J m all Jordan blocks of matrix R with pure imaginary eigenvalues 

iui ,..., iu m respectively: 



( 

iuj 

1 

0 . 

.. 0 

\ 

Jj — 


0 

iuj 

1 . 

.. 0 



V 

0 

0 

0 . 

.. iuj 

/ 


We assume that the Jordan blocks are arrange in such an order that oji < u >2 < ... < 
uj m . Let P\,, P m be /?,-invariant subspaces associated to Jordan blocks of 

dimensions n\,... ,n m respectively. It is known that for every j = the value 

n + (Jj ) — n-(Jj) is equal to —1, 0, or 1, and no(Jj) = 0. We use classification given by M. 
Krein. 

Definition 5.2. We say that the block Jj contains n+{Jj) eigenvalues iujj of the first type, 
and n-(Jj) eigenvalues iuj of the second type. 

For every subspace Pj there exist a number f3j £ {—1,1}, and a matrix Sj such that the 
columns of Sj span Pj , RSj = SjJj, 
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SpSj = ej 


0 0 

0 0 

(- l) m i 0 


0 -1 

(- 1) 2 0 

0 0 


(a) if the size nj of Jj is even, then n + (Jj) — n_(Jj) = 0 and ej = (—l) n '/ 2 /3j ; 

(b) if the size rij of Jj is odd, then n+(Jj) — n_(Jj) = j3j and ej = (—l)^ -1 )/ 2 *^-. 
Moreover, matrices Sj for distinct j are J-orthogonal: S* 1 JSj 2 = 0 if j\ / jq- 

The value f3j is called index of Jj, and we call invariant space Pj neutral, of the first type, 
or of the second type, n + (Jj) — n-(Jj) is equal to respectively zero, one or negative one. 

Denote by 5+ ( S -) a matrix whose columns span the i?-invariant subspace associated 
to eigenvalues with positive (respectively, negative) real parts. Then S + and S- are J- 
orthogonal to Sj for every j = 1,..., m. Besides, all columns of matrices S-, £+, Si,, S m 
present a basis of C 2n . 

Fix j € { 1,... ,m} and consider a matrix V such that JV is orthogonal to S_, S + , and 
all matrices Sk with k ^ j. Then 

det(i? + V(JV)* - XI) = det (R - A/)(l + ( JV)*(R - X TtV) = 

= det(i? - AI)(1 + ( JV)*Sj{Jj - XI)~ 1 (S*JS j )~ 1 S*JV) 

Denote Pj = S*JSj/ej. Consider the matrix of quadratic form in the last brackets. We 
have P _1 = (—1 ) m i~ 1 Pj, and 


(jj - xi r 1 = 


j —A (iujj —\ p 


(-1 ) m J ~ 2 


Therefore 


(-1 ) m j 






(Jj XI) (ejPj) — £■ 1 (■ 


(-1 ) m J 


For even toj = 2rj we have ej = (—1) r , and 


(Jj - XI)- 1 (e j Pj )~ 1 = P(-l) r > (^-A) 


A) r -? (icjj — A) r i~ 


(icjj—X) r i 


Therefore for A = iu we have 



K. KISSI 





1 

(iJj — L0) 2r j 

_ — i 

(iJj —Ld) 2r j ^ 


_ i 

(cjj—cj) 2r j 

( <jJj—Oj) Zr j 


=7 


H- 1P +1 \ 

Uj-U 1 

0 


\ i(-l) r 0 

\ LOj —U) 


0 


0 


If we choose vector V such that S^(JV) = 0 for all k / j. and S*(JV) 
(that is, v is parallel to the last column of matrix Sj), then 


/ 


1 + (JVTSjiJj - XI)~ 1 (SjJSj)~ 1 Sj JV = 1 + 8 2 p j { ' U)2rj . 

Hence, for sufficiently small 5 and positive (3j all pure imaginary eigenvalues of matrix R 
corresponding to block Jj leave imaginary axis and become pairs of eigenvalues with non 
zero real parts symmetric with respect to imaginary axis. 

If f3j = — 1 then for sufficiently small <5 exactly two eigenvalues remain on the imaginary 
axis, and the rest rrij — 2 eigenvalues leave this axis. Among two remaining eigenvalues the 
bigger is of the first type, and the smaller is of the second type. With 5 increasing the first 
eigenvalue goes up the imaginary axis, and the second eigenvalue goes down. 

Now consider the blocks with odd dimension: mj = 2 rj + 1. Then ej = (—1 ) r H/3, and 


/ _ i 

1 (iuj- A); r j +i 


(J j -AJ)- 1 (e j P i )- 1 =/3(-iP 




(iujj—\) 2r j (iujj—\) 2r j ^ 

0 


For A = iu we get 


l 


{Jj ~ iuI ) ( 6 j P j) = P 


(c Oj —uj) 2r j +1 (c Jj —U)) Zr 0 




V 


(ujj —u)) 2r j (ujj —uj) 2r i T 


UJn —U) 




0 J 


Again, if V is such that S^(JV) = 0 for all k ^ j, and S*(JV) = (S, 0,... , 0)* (that is, 
is parallel to the last column of matrix Sj), then 


1 + (JV)*Sj(Jj - XI)- 1 (S* J Sj) -1 S* JV = 1 + 5 2 (3j ^ _ * )2rj+1 . 

Therefore, for small 6 all eigenvalues of matrix R corresponding to block Jj but one leave 
imaginary axis. If j3 = 1, then the eigenvalue which remains on imaginary axis is of the 
first type, and it goes up the imaginary axis with increasing positive 5. If /3 = — 1, then this 
eigenvalue is of the second type and it goes down imaginary axis with increasing positive 5. 

Thus, we get the following result. 
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Theorem 5.3. There exists a nonnegative matrix M such that the eigenvalues of matrix 
R — tMJ with number t increasing from zero have the following behaviour. 

(a) For each Jordan block Jj of matrix R of odd dimension 2rj + l with index f3 = 1 exactly 
2rj eigenvalues leave imaginary axis with increasing t from zero, and the rest eigenvalue 
goes up imaginary axis, and has the first type. 

(b) For each Jordan block Jj of matrix R of odd dimension 2 rj + 1 with index (3 = 
— 1 exactly 2 rj eigenvalues leave imaginary axis with increasing t from zero, and the rest 
eigenvalue goes down imaginary axis, and has the second type. 

(c) For each Jordan block Jj of matrix R of even dimension 2 rj with index (3 = 1 all 
eigenvalues leave imaginary axis with increasing t from zero. 

(d) For each Jordan block Jj of matrix R of even dimension 2 rj with index (3 = — 1 
exactly 2 rj — 2 eigenvalues leave imaginary axis with increasing t from zero. One of the 
rest eigenvalues goes up imaginary axis and has the first type, and the other eigenvalue goes 
down imaginary axis and has the second type. 

From the representation above we see, that if two pure imaginary eigenvalues of R — tMJ 
having different types meet for some number t, then further we do not change them. More 
precisely, we modify matrix M (by eliminating the terms corresponding to Jordan blocks 
with these eigenvalues) such that further these eigenvalues and corresponding eigenvectors 
remain constant. 

We can finally get Hamiltonian matrix with all pure imaginary eigenvalues having even 
multiplicity only if each eigenvalue of the first type eventually meets an eigenvalue of the 
second type. Taking into account the fact that with increasing t eigenvalues of the first 
type go up imaginary axis, and eigenvalues of the first type go down imaginary axis, it can 
happen if and only if for every uj the number of Jordan blocks of R with eigenvalues iujj < u ; 
of the first type is not less than the number of Jordan blocks of R with eigenvalues iuij < uj 
of the second type plus the number of Jordan blocks of R of neutral type with eigenvalue 
iuj and index f3 = — 1. 

Denote 


s(w) = m. |_(w) — m_( uj) — mo(u), 

where m+(w) is the number of odd dimensional Jordan blocks of matrix R with eigenvalues 
iuj such that t Oj < uj, (3 = 1, m_(w) is the number of odd dimensional Jordan blocks of 
matrix R with eigenvalues iuj such that ujj < uj, (3 = — 1, and mo(w) is the number of even 
dimensional Jordan blocks of matrix R with eigenvalues iuj such that (3 = — 1. 

Theorem 5.4. There exists a positive definite matrix M such that matrix R — MJ has no 
pure imaginary eigenvalues if and only if for every pure imaginary eigenvalue iujj of matrix 
R we have 


s(ujj) > 0. (13) 

Taking into account the result of the previous section, we get the following main result. 

Theorem 5.5. The Riccati inequality J7p has a solution if and only if inequality |T3| ) holds 
for all uj £ R. 
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6. A Numerical Example 
Consider the Riccati inequality: 


HA + A*H + Gi - HBT^B^ < 0, 


where: 


{A,B,G} = 



1 -1 1 



6 -2 
-2 -3 


-2 -2 -3.9 



( 14 ) 


(15) 


and 


r = 


-10 

o 


o 

o.i 


Now computing the eigenvalues of A yields {1,1,1}. This it checks that matrix A has no 
purely imaginary eigenvalues. Notice also that matrix G and T are Hermitian, and matrix 
T is sign indefinite. 

Associated Hamiltonian matrix of the inequality being: 


R = 


A -BT~ l B* 
-G -A* 


V 


1 

-1 

1 

0.1 

0.1 

0. 

0 

1 

1 

0.1 

0.1 

0. 

0 

0 

1 

0. 

0. 

-10. 

-6 

2 

2 

-1 

0 

0 

2 

3 

2 

1 

-1 

0 

2 

2 

3.9 

-1 

-1 

-1 


\ 


(16) 


/ 


Notice that eigenvalues of R are ±6.0506i, ±1.5866i and ±1.7964. Thus, there are simple 
pure imaginary eigenvalues of matrix R. 

The corresponding Riccati equation has no solution. 

Now consider some positive definite matrix, for instance 


(17) 



Then 


Gi =G + C = 


10 0 0 

0 1 0 

0 0 0.1 


(18) 


Notice that the matrix £ is positive definite because it has the following eigenvalues {8,2, 2}. 
The equality becomes: 


HA + A*H + Gi- HBT~ 1 B*H = 0 


( 19 ) 


With all conditions satisfied, a Hermitian matrix H that satisfies (26) is equal to 
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/ 128.485 -178.389 -7.18338 \ 

H= -178.389 259.987 12.4241 (20) 

\ -7.18338 12.4241 1.25879 ) 

It is however straight-forward to check that this matrix H is a solution of inequality (21). 

7. Conclusion 

We consider the problem of solvability of Riccati inequalities with arbitrary nondegen- 
erous quadratic form. The necessary and sufficient condition for solvability of these in¬ 
equalities were obtained and expressed in terms of the associated Hamiltonian matrices. 
The proof of this result is based on special representations of Hamiltonian matrices. An 
extension of this result to matrix pencils is a subject of possible future investigations. 
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